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Abstract 

A voice interactive computer system having voice digi- 
tizing circuitry for digitizing voice input from an opera- 
tor. The voice digitizing circuitry is preferably placed on 
a computer card in operative association with a central pro- 
5 cessing unit in the computer. The digitized voice input may 

be selectively replayed and compared with a prerecorded 
language vocabulary stored on a compact disc read only 
memory connected to the computer. The compact disc read 
only memory is also used for storing software which provides 

1Q interaction between the voice digitizing circuitry and the 

computer central processing unit and random access memory in 
the computer. The voice digitizing circuitry may be placed 
on a separate computer card positioned in a slot in a bus in 
operative association with the central processing unit or 

15 combined with other cards. The digitized voice input may 

also be stored on magnetic media such as a computer disc for 
later review by others, such as a teacher. A method of 
using the voice interactive computer system in teaching a 
second language to a student having proficiency in a first 

20 language is also disclosed. 
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VOICE INTERACTIVE COMPUTER SYSTEM 

Background Of The Invention 

1, Fie ld Of The Invention 

This invention relates to voice interactive computer 
systems, and more particularly, to a computer system usable 
in a teaching environment and having means for digitizing 
voice input from a student-operator and for selectively 
replaying the digitized voice input by the student or a 
teacher . 

2. D escript io n Of The Prior Ar t 

The teaching of foreign languages has traditionally been 
classroom time intensive. It is necessary to have the 
interaction between student and teacher so that the student 
can make the necessary learning connections between 
speaking, reading and writing. While learning to read the 
language is important and should not be delayed, multi- 
sensory input speeds and reinforces the process of acquiring 
the foreign language, verbally as well as written. In the 
interaction between the student and teacher, the teacher's 
proper pronunciation of the foreign language word or phrase 
is usually repeated as often as necessary, and there is an 
obvious, immediate aural comparison between the teacher's 
pronunciation and the student's pronunciation. However, a 
problem in most classroom situations is that devotion of 
individual attention by the teacher to a particular student 
is limited by time constraints. Because of this, the fami- 
liar language laboratory has been developed and is in 
widespread use as an auxiliary teaching tool. 
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A typical language laboratory utilizes phrases prere- 
corded in analog form by a language expert. The students 

can listen to these expert recordings and then repeat the 
words and phrases. The student's input is recorded in ana- 

5 log form, such as on audio tape media. The student's 
recorded portion may then be later replayed by the teacher 
with some systems. 

A problem, however, is that there is no easy way for the 
student to replay what he or she has spoken to compare it 

10 with the expert's pronunciation of the same words or phra- 
ses. This is true because the student has no real control 
over the recording equipment. All students hear the expert 
simultaneously and record their responses simultaneously. 
Thus, slower students are quickly left behind. 

15 Thus, an important aspect of interaction in language 

learning is not available in present language laboratories. 
That is, the student is not able to hear what he or she says 
and to alternately compare this with the proper pronun- 
ciation by the expert. Also, in such language laboratories, 

20 the only written materials are preprinted. In other words, 
there is no immediate correlation between what is spoken and 
what is written. Again, the: student loses an important con- 
nection between the verbal and written words or phrases. 

The present invention solves these language laboratory 

25 deficiencies by providing a voice interactive computer 
system which allows the student to digitally record his or 
her spoken words or phrases and immediately replay this 
recording or the expert prerecording by direct input from 
the computer keyboard. The student may quickly and easily 

30 selectively compare his or her spoken words or phrases with 
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those pronounced properly by the expert, the expert pronun- 
ciation portion being stored in digitized form which may be 
easily addressed by the computer. Since each student is at 
a separate computer, each student is in control of his or 

5 her learning session. 

The student is also presented with a visual display of 
specific graphics and/or written text at substantially the 
same time he or she is hearing the verbal counterpart, thus 
allowing a learning connection between graphic, written and 

10 verbal aspects which is not available in language labora- 
tories. 

While the system of the present invention cannot totally 
substitute for individual instruction between a student and 
teacher, it provides considerably more interaction between 
15 expert and student pronunciation and between verbal and 
written material than does the prior art. Because the stu- 
dent is in control of the system, the student may proceed at 
his or her own pace. 

20 Summary Of The Invention 

The voice interactive computer system of the present 
invention comprises a computer central processing unit, data 
entry means in operative association with the central pro- 
cessing unit, memory means in operative association with the 

25 central processing unit, software stored in the memory 
means, and voice digitizing means for digitizing voice input 
of the operator. The software comprises programming 

instructions, a digitized voice vocabulary, and graphics and 
text corresponding to the voice vocabulary. The voice digi- 

30 tizing means also provides a means for retrieving the digi- 
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tized voice input from memory and replaying the input and 
also for retrieving at least a portion, of the voice vocabu- 
lary from the memory means in response to at least one of a 
direct instruction from the operator and a portion of the 
programming instructions. 

The apparatus further comprises microphone means for 
receiving the voice input from the operator and transmitting 
the voice input to the voice digitizing means and speaker 
means in operative association with the voice digitizing 
means for audibly reproducing the retrieved voice input and 
vocabulary portion. 1 Preferably, the microphone means and 
speaker means are characterized by a headset which frees the 
hands of the operator . 

The voice digitizing means is preferably characterized 
by a card means positionable in a slot in bus means con- 
nected to the central processing unit. 

The apparatus further comprises data storage means in 
operative association with the central processing unit, 
preferably, the voice digitizing means also comprises means 
for storing the digitized voice input in the data storage 
means. The data storage means comprises at least one of 
another memory means and a disc storage means. The other 
memory means may be characterized by a random access memory. 

in the preferred embodiment, the first mentioned memory 
means comprises a compact disc read only memory. 

One preferred method of using the computer system of the 
present invention is for teaching a second language to a 
student having some proficiency in a first language. The 
method comprises the steps of storing a voice language voca- 
bulary in digitized form in memory means in operative asso- 
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ciation with a computer central processing unit, placing 
voice digitizing means in operative association with the 
central processing unit, storing software in the memory 
means and running the software in the central processing 

5 unit for providing interaction between the central pro- 
cessing unit and the voice digitizing means, digitizing an 
analog voice input signal from the student, storing the 
digitized voice input in the memory means, and comparing the 
digitized voice input with at least a portion of the 

10 language vocabulary. Graphics and text corresponding to the 
voice vocabulary may also be stored in the memory means. 

The step of storing the vocabulary preferably comprises 
prerecording the vocabulary on a compact disc read only 
memory, and the step of storing the software comprises 

15 placing the software on the compact disc read only memory. 
The graphics and text are also prerecorded on the compact 
disc read only memory. 

The step of placing the voice digitizing means in opera- 
tive association with the central processing unit comprises 

20 placing voice digitizing circuitry on a computer card and 
positioning the card in the computer. 

The step of storing the digitized voice input comprises 
storing the voice input in a random access memory in opera- 
tive association with the central processing unit of the 

25 computer. 

The step of comparing the digitized voice input with the 
portion of the vocabulary comprises selectively retrieving 
the voice input or vocabulary portion from the memory means 
and selectively replaying the digitized voice input and the 
30 portion of the vocabulary in analog form. Graphics and text 
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may be shown on monitor means substantially simultaneously 
for intimate interaction with the audio. 

The method of teaching a foreign language further 
comprises the step of storing the voice input in storage 
5 means for subsequent review by the teacher of the student. 
This step of storing the voice input preferably comprises 
storing the input on magnetic media, such as a computer 
disc . 

It is an important object of the present to provide a 
10 computer system having means for digitizing voice input from 
an operator and for selectively replaying the digitized 
voice input. 

It is another object of the invention to provide a com- 
puter system with intimately interactive audio, graphics and 
15 text. 

Tt is a further object of the invention to provide a 
computer system suitable for teaching a second language to a 
student having proficiency in a first language. 

It is an additional object of the invention to provide a 
20 computer system having voice digitizing means for digitizing 
voice input of an operator and retrieving the digitized 
voice input and for also retrieving at least a portion of a 
voice vocabulary stored in memory means, such retrieval 
being in response to a direct instruction from an operator 
25 or from software programming instructions. 

A further 'object of the invention is to provide a 
language teaching computer system having a voice vocabulary 
stored on a compact disc read only memory. 

Still another object of the invention is to provide a 
30 method of teaching a second language to a student having 



-6- 



10 



1314395 

some proficiency in a first language in which digitized 
voice input of the student may be compared with a portion 
of a prerecorded language vocabulary. 

Additional objects and advantages of the invention will 
become apparent as the following detailed description of the 
preferred embodiments is read in conjunction with the 
drawings which illustrate such preferred embodiments. 

Brief Description Of T he Drawings 

FIG. 1 shows a schematic of a preferred embodiment of 
the voice interactive computer system of the present 

15 invention, 

FIG. 2 shows a schematic of an alternate embodiment of 

the invention, 

FIG. 3 is a functional block diagram of the voice card 

used in the invention. 

. FIGS. 4A and 4B are together a circuit schematic 
showing the analog circuitry in the voice card. 

FIG. 5 shows the relationship between FIGS. 5A, 5B r 5C 
and 5D which are together a circuit schematic of the digital 
circuitry of the voice card. 

FIGS. 6-19 illustrate flow charts for the computer 
software main program used in the system. 

Description Of The Prefe rred Embodiment 

Referring now to the drawings, and more particularly 
to FIG. 1, an embodiment of the voice interactive computer 
system of the present invention is shown and generally 
designated by the numeral 10. The major hardware components 
of system 10 include a computer 12 and a module 14, although 
as will be understood herein, computer 12 and module 14 
could be combined into a single housing if desired. 
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Computer 12 is of a kind generally known in the art, 
such as an IBM PC XT, although the system may be adapted to 
virtually any kind of computer and is not intended to be 
limited to an IBM PC* Computer 12 includes data entry means 
5 such as a keyboard 16 and data storage means, such as a disc 
drive 18. 

Disc drive 18 may include one or more of any known disc 
drives, such as the various sizes of floppy disc drives or 
hard disc drives. The invention is not intended to be 

10 limited to any particular data storage means. 

Both the keyboard and disc drive are in operative asso- 
ciation with a central processing unit (CPU) 20 of computer 
12 and thus also in operative association with a memory 
means 22 such as a random access memory (RAM), all of a kind 

15 known in the art. 

Forming a portion of computer 12 and connected to the 
other components thereof is a row of computer card slots or 
slot bus 24, also called an input/output bus or I/O bus. 
Again, slot bus 24 is of a kind known in the art and is 

20 adapted for receiving various generally known computer 
cards. Slot bus 24 includes a plurality of slots such as 
26, 28, 30, 32 and 34. The number of slots is not critical 
and is not intended to be a limiting feature of the inven- 
tion. 

25 Also connected to central processing unit 20 and forming 

a portion of computer 12 is a cathode ray tube (CRT) monitor 
36 on which is displayed data in a normal manner. All of 
the components of computer 12 may be enclosed within a 
single housing 38 or separate housings for the various com- 

30 ponents as desired. 
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Module 14 preferably includes a housing 40 which enclo- 
ses a row of card slots or slot bus 42 similar to slot bus 
24 in computer 12. In FIG . 1, slot bus 42 includes slots 
44, 46, 48, 50 and 52, but the number is not critical. 

5 Another component included in module 14 is another 

memory means preferably in the form of a compact disc read 
only memory (CDROM) drive 54. CDROM drive 54 is of a kind 
known in the art and is preferred because of the large 
amount of memory storage available thereon. However, any 

10 other type of memory storage means such as read only memory 
(ROM) chips or a hard disc drive may be utilized as long as 
the memory capacity thereof is sufficient. The invention is 
not intended to be limited to a CDROM drive. 

CDROM drive 54 is connected by a cable 56 to a CDROM 

15 interface card 58. Interface card 58 is in turn connected 
to slot bus 42 in module 14 by plugging interface card 58 
into one of the slots, for example slot 52. 

A bus interface 60 interconnects slot bus 24 in computer 
12 with slot bus 42 in module 14. Bus interface 60 includes 

20 a cable 62 having a first bus interface card 64 at one end 
of the cable and a second bus interface card 66 at the other 
end of the cable. First bus interface card 64 plugs into 
one of the slots, such as slot 28, in slot bus 24 in com- 
puter 12. Second bus interface card 66 plugs into one of 

25 the slots, such as slot 44, in slot bus 42 in module 14. 
Bus interface 60 may be of any kind known in the art and is 
generally referred to as a transmitter card. 

It is contemplated that a plurality of computers may be 
connected to module 14. For example, a second computer 12* , 

30 substantially identical to first computer 12, may be con- 
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nected to module 14 by plugging second bus interface card 
66' thereof into another slot, such as slot 46 , in slot bus 
4 2 in the module. Additional computers may also be con- 
nected to module 14 in a similar manner. The only physical 
limitation is the number of slots available in slot bus 42. 

Computer system 10 also comprises voice digitizing means 
such as a voice card 68 plugged into another slot in slot 
bus 24 in computer 12 F such as slot 26. Other computers in 
system 10 also have such voice digitizing means plugged 
thereinto. Connected to voice card 68 by a cable 70 are 
speaker and microphone means. Preferably, this is in the 
form of a headset 72 in which the speaker means includes an 
earphone 74, and the microphone means is a microphone 76 
attached thereto. A headpiece 78 allows the operator of 
computer 12 to wear headset 12 while keeping his or • her 
hands free to operate the computer. A separate speaker and 
microphone could also be utilized if desired. 

Using control through keyboard 16, voice card 68 
receives voice input from the operator through microphone 76 
and digitizes the voice input in a manner hereinafter 
described in more detail. An optional manual control switch 

79 may be piaced in cable 70 to control microphone 76 exter- 
nally of keyboard 16 as desired. 

Referring now to FIG. 2, an alternate embodiment of the 
voice interactive computer system of the present invention 
is shown and generally designated by the numeral 80. System 

80 also includes a computer 12 and a module 14. As with the 
first embodiment, computer 12 in system 80 includes a 
housing 38 which houses a keyboard 16, data storage means, 
such as disc drive 18, a central processing unit 20, memory 
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means, such as random access memory 22, a slot bus 24 and a 
monitor 36. Again, separate housing portions for the 
various components may be utilized as desired. 

Module 14 in alternate system 80 again includes another 

5 memory means, such as a CDROM drive 54 and a slot bus 42. 

A combination bus interface/voice card/CDROM interface, 
generally designated by the numeral 82, interconnects com- 
puter 12 and module 14 in system 80. Interface 82 includes 
a cable 84 having a first interface card 86 at one end 

10 thereof which is plugged into a slot, such as slot 26, in 
slot bus 24 in computer 12. Interface card 86 includes all 
of the components and performs the same functions as first 
bus interface card 64 and voice card 68 in first system 10. 
By combining the circuit components on a single card, the 

15 amount of hardware is reduced which decreases the cost. An 
additional advantage is that another slot, such as slot 28, 
is freed in computer 12 for other usage. 

The other end of cable 84 is connected to a second 
interface card 88 which plugs into a slot, such as slot 44, 

20 in slot bus 42 in module 14. Second interface card 88 
includes all of the components and performs the same func- 
tions as CDROM interface card 58 and first bus interface 
card 66 in first system 10. Again, a card is eliminated 
which reduces the cost,. and an additional slot, such as slot 

25 52, is freed in module 14 for other usage. 

Headset 72 is connected to interface card 86 by a cable 
90, and CDROM drive 54 is connected to second interface card 
88 by a cable 92. Optional switch 79 may be placed in cable 
90. 

30 As with first embodiment 10, it is contemplated that 

multiple computers, such as computer 12', may be utilized in 
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system 80. Computer 12' is connected to module 14 by 
interface 82 1 having a cable 84 1 with a second interface 
card 88' plugged into a slot, such as slot 46, in slot bus 
42 in the module. A cable 92' interconnects second interface 
card 88 1 with CDROM drive 54. Additional computers may be 
connected in a similar manner. 

Referring now to FIGS. 3-5, the details of voice card 
68 of system 10 or the voice card portion of interface card 
86 of the system 80 will be described. FIG. 3 is a 
functional block diagram of the circuitry schematics shown 
in FIGS. 4 A and B and 5A-D. FIGS. 4A and B show the analog 
circuitry required for filtering and amplification, and 
FIGS. 5A-D show the digital circuitry required to interface 
to slot bus 24 in computer 12 as well as to convert the 
15 analog voice signal to digital information. Reference will 

be made in this discussion only to voice card 68 of system 
10, but it should be understood that this applies equally 
to the voice card portion of interface card 86 of alternate 
system 80 . 

In addition to the reference numerals herein, specific 
electrical components shown in the circuit schematics will 
be identified by the reference codes shown in those 
schematics . 

In block 94, the audio signal from microphone 76 must 
be amplified to a suitable level by integrated circuit 96 
(IC8) to interface through line 98 to analog to digital 
converter 100 (IC14) . The signal must pass through one-half 
of low pass filter 102 (IC11) before being converted to a 
digital signal. Low pass filter 102 will attenuate any 
voice frequencies which are one-half of a sampling 



20 



25 



30 



frequency . 

In analog to digital converter 100, the analog signal 
is momentarily saved in a sample and hold circuit. Converter 
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100 is an eight bit successive capacitor ladder conversion. 
The output of analog digital converter 100 is then sent as a 
parallel eight bit word to parallel to serial shift register 
104 (IC13) through lines 106. 

5 Shift register 104 accepts a parallel signal from analog 

to digital converter 100 f and the shift register can then be 
clocked to allow a serial stream of data to be fed to an 
adaptive delta pulse code modulation (ADPCM) processing chip 
108 (IC12). Processing chip 108 performs the ADPCM 

10 algorithm on the incoming data and places the results on 
lines 110 which are connected to slot bus 24 of computer 12 
through standard interface chips 112 (IC21), 114 (IC22) and 
116 (IC23). Chip 112 serves as an input buffer, and chip 
114 serves as an output buffer. Input/output lines 118 

15 (D0-D7) directly connect to slot bus 24 , and chips 112 , 114 
and 116 allow processing chip 108 to talk to slot bus 24. 
Chips 112, 114 and 116 are bi-directional and tr istateable . 
Thus, processor chip 108 may both send data to computer 12 
and accept data from the computer. 

20 Timing control is provided by timing control circuit 120 

which is connected to clock circuit 122. Clock circuit 122 
includes an oscillator 124 tOSCl) and a counter 126 (IC15) 
known in the art. 

In block 128, previously digitized data may be read from 

25 memory 2 2 of computer 12 and input to the data bus of pro- 
cessing chip 108. Processing chip 108 converts the digital 
information back to an analog signal. It is necessary to 
both amplify and filter the signal so that the original 
speech signal will sound suitable to the operator. This 

30 amplification is done by integrated circuit 130 (IC10), and 
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the filtering is accomplished by the other half of low pass 

filter 102 (IC11) . 

The audio signal is amplified by output amplifier 132 
(IC9) to a level sufficient to drive earphone 74 of headset 
72 or a separate speaker. 

In block 134, integrated circuits 136 (IC18), 138 
(IC19), and 140 (IC20) allow computer 12 to input to the 
circuitry through address lines 142 (AD4-AD9 and -AEN) , 
write line 144 (-IOW) and read line 146 (-I0R). 

Switches 148 (SW2) can be set to decode a unique 
address in connection with the signals through write line 
144 and read line 146 which will ultimately control the 
operation of processing chip 108, and thus the voice 

functions themselves. 

It will thus be seen that the complete circuit of voice 
card 68 is capable of digitizing an analog voice signal and 
storing the information in the memory of computer 12. 
Likewise, previously recorded digital information can be 
converted back to an analog voice signal. All of this, of 
course, is under the control of software programs written to 

support this circuitry. 

in the preferred embodiment , the software includes a 
computer program written in a high level language marketed 
under the trade-mark "Tencore". Tencore is a commercially 
available language produced by Computer Teaching 
Corporation, of Champaign, Illinois. A listing of the 
program is included as Appendix A in the specification. In 
addition, the software includes an assembly language program 
which ties voice card 68 or the voice card portion of 
30 interface card 86 into the Tencore language program. A 
listing of the assembly language program is in Appendix B in 
the specification. 
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FIG. 6 is a flow diagram of the overall Tencore language 
program. A flow chart of the Introduction portion of the 
program is shown in FIG. 7. FIG. 8 presents a detailed flow 
chart of the Menu Scanner Routine indicated in FIG. 7. 

5 The main program includes portions for numbers, vocabu- 

lary and grammar. The Main Numbers Program is described in 
the flow chart shown in FIG. 9. The flow chart of the 
Numbers Instruction Program is shown in FIG. 10, and a flow 
chart of the Numbers Instruction Routine is given in FIG. 

10 11. FIG. 12 shows a flow chart of the Numbers Drill 
Routine . 

A flow chart of the Vocabulary Instruction Portion of 
the main program is shown in FIG. 13. The Vocabulary Learn 
and Review portion is shown in the flow chart of FIG. 14, 
15 and the Vocabulary Drill is illustrated in the flow chart of 
FIG. 15. 

The flow chart in FIG. 16 shews the Grammar Drill por- 
tion. 

FIG. 17 gives a flow chart of the Text Play and Repeat 
20 portion of the main program, and FIG. 18 is a flow chart of 
the Repeat Text Routine; 

The Dictation portion of the program is presented in the 
flow chart of FIG. 19. 

The Tencore language program of Appendix A and the 
25 assembly language program of Appendix B both have detailed 
comments printed in the program listings. A person skilled 
in the art will easily understand the software used in the 
present invention after a study of the flow charts of FIGS. 
6-19 and the program listings in Appendices A and B. 
30 The software is preferably stored in CDROM drive 54 and 

is activated upon start-up of either system 10 or 80. When 
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the software is running in computer 12, the various func- 
tions of voice card 68 or the voice card portion of inter- 
face card 86 are activated. Again, reference in this 
discussion is made only to voice card 68, but this applies 

5 also to the voice card portion of interface card 86. 

In using the system in a language-teaching situation, 
the operator or student is not required to be a computer 
expert- Basically, the system is turned on, and the soft- 
ware then functions and instructs the student throughout the 

10 process. 

For teaching foreign languages, an extensive voice voca- 
bulary is stored in CDROM drive 54 including the native or 
first language of the student as well as the language being 
taught. In most cases, one of these languages will be 

15 English. However, the invention is not intended to be 
limited to the teaching of foreign languages to English- 
speaking students. It applies equally well, and perhaps 
with more social impact, to the teaching of English as a 
second language to non-English-speaking persons. This is a 

20 particularly important function sociologically so that 
non-English-speaking persons can be more easily assimilated 
into, and work within, an English-speaking society. 

Once the system is running and the student is wearing 
head set 72, the student may speak into microphone 76 when 

25 instructed by the program. Control may be taken through 
keyboard 16 or optional switch 79 for recording this voice 
input is digitized by voice card 68 and stored in memory in 
computer 12, ordinarily RAM 22. For example, the computer 
may display a foreign language phrase and the English 

30 equivalent thereof in text form on monitor 36 as well as 
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giving an aural signal to the student of the phrase through 
earphone 74 of headset 72. Corresponding graphics may also 
be displayed on monitor 36. The student may then verbally 
repeat the foreign language word or phrase which is then 

5 stored in the system as described. By simple key strokes , 
on keyboard 16 f the student may then replay the pro- 
fessionally spoken phrase from the voice vocabulary in the 
system and also replay his or her own spoken version of the 
word or phrase. Both can be replayed as many times as 

10 desired so that the student gets a true interaction with the 
system. The student may make additional attempts to pro- 
perly pronounce the word or phrase as the student desires. 
Because the student is in control of the system, the student 
may proceed at his or her own pace. 

15 The software and vocabulary may be written to provide 

any number of verbal and written exercises as desired. In 
all cases, the student may immediately replay his or her 
spoken version of the phrase and compare it to the proper 
pronunciation. By such repetition of this verbal aspect, 

20 there is increased comprehension. 

Upon start-up of the system, the student will place 
memory media, such as a floppy disc, in disc drive 18, and 
the system will automatically record his or her spoken words 
or phrases on the student's disc. This data disc may then 

25 be reviewed at a later time by a teacher for evaluation and 
additional instruction as necessary. 

Because of the unique digitized recording of the stu- 
dent's voice and ability to replay on command, along with 
corresponding graphics and text, the system provides an 

30 interaction much closer to that of a teacher-student 
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classroom interaction than with previously known devices 
such as language laboratories. 

While the system has been described in particular for 
a language-teaching situation, it will be seen that by 
modification of the software, the system is easily adaptable 
for other voice interactive usages. 

It can be seen, therefore, that the voice interactive 
computer system of the present invention is well adapted to 
carry out the ends and advantages mentioned, as well as 
those inherent therein. While presently preferred 

embodiments of the invention have been described for the 
purposes of this disclosure, numerous changes in the 
arrangement and construction of parts may be made by those 
skilled in the art. All such changes are encompassed within 
the scope and spirit of the appended claims. 
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THE EMBODIMENTS OF THE INVENTION IN WHICH AN EXCLUSIVE 
PROPERTY OR PRIVILEGE IS CLAIMED ARE DEFINED AS FOLLOWS; 

1. An interactive instruction apparatus comprising: 

video display means for presenting text and graphic messages 
selected to exercise student reading and comprehension skills; 

audio output means for presenting audio messages selected 
to exercise student listening skills; 

audio input means for receiving audio responses selected 
to exercise student speaking skills; 

text input means for receiving text responses selected to 
exercise student writing skills; 

student speech reproduction means for receiving, digitizing 
and reproducing a student speech response; 

reference response generation means for generating a 
reference speech response from a digital recording; 

exercise generating means for generating a series of 
exercise, said exercises comprising: the presentation of text 
and graphic messages through the video display means, the 
presentation of audio messages through the audio output means, 
the reception of text responses through the text input means and 
the reception of audio responses through the audio input means. 

at least one of said exercises including a text message for 
prompting a student speech response, an interactive period during 
which the student speech reproduction means receives and 
reproduces a student speech response and the reference response 
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generation means generates a reference response in comparative 
relation with the student response; and 

exercise control means responsive to the student for either 
1) autonomously signalling the exercise generating means to 
generate an exercise , or alternatively 2) signalling the 
exercise generating means to repeat an interactive period. 

2. An apparatus as in claim 1 wherein: 

the message presenting means includes a plurality of 
presenting means, each for presenting a message to a student 
asynchronously with other presenting means; 

the student speech reproduction means includes means for 
receiving and reproducing a plurality of asynchronous student 

speech responses; 

the reference response generation means includes means for 
generating a plurality of reference responses, each in 
comparative associative relation with a reproduced student speech 
response ; 

the exercise control means includes means responsive to 
each of a plurality of students for either 1) autonomously 
signalling the exercise generating means to generate an exercise 
for a student asynchronously with exercises for other students, 
or alternatively 2) signalling the exercise generating means 
to repeat an interactive period for an exercise for a student 
asynchronously with interactive period for other students. 
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3. An apparatus as in claim 1 wherein audio and video 
messages of an exercise simultaneously symbolize a student speech 
response associated with that exercise. 

4. An apparatus as in claim 1 further comprising student 
response storage means for recording a student speech response 
of a medium separable from the apparatus. 



5, An interactive instruction apparatus comprising: 

message presenting means for presenting text and graphic 
visual messages and for presenting audio messages of an exercise 
to a student; 

message receiving means for receiving text and audio 
responses from a student; 

student speech reproduction means for receiving and 
reproducing a student speech response ? 

reference response generation means for generating a 
reference speech response; and 

exercise generating means connected to the message 
presenting means, to the message receiving means, to the student 
speech reproduction means and to the reference response 
generation means for generating a series of exercises, said 
exercises comprising the presentation of text, graphic, and audio 
messages, and the reception of text and audio responses; 

wherein at least one of said exercises includes a message 
for prompting a student speech response, and an interactive 
period for receiving and reproducing a student speech response 
in comparative relation with a reference speech response. 
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